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projects  that  both  comport  with  solid  standards  of  scholarship,  and  address  relevant 
acquisition  issues.  These  years  of  experience  have  shown  us  the  difficulty  in  attempting  to 
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We  gratefully  acknowledge  the  ongoing  support  and  leadership  of  our  sponsors, 
whose  foresight  and  vision  have  assured  the  continuing  success  of  the  Acquisition 
Research  Program: 

•  Office  of  the  Under  Secretary  of  Defense  (Acquisition,  Technology  &  Logistics) 

•  Program  Executive  Officer  SHIPS 

•  Commander,  Naval  Sea  Systems  Command 

•  Army  Contracting  Command,  U.S.  Army  Materiel  Command 

•  Program  Manager,  Airborne,  Maritime  and  Fixed  Station  Joint  Tactical  Radio  System 


ACQUISITION  RESEARCH:  CREATING  SYNERGY  FOR  INFORMED  CHANGE 


- 1  - 


•  Program  Executive  Officer  Integrated  Warfare  Systems 

•  Office  of  the  Assistant  Secretary  of  the  Air  Force  (Acquisition) 

•  Office  of  the  Assistant  Secretary  of  the  Army  (Acquisition,  Logistics,  &  Technology) 

•  Deputy  Assistant  Secretary  of  the  Navy  (Acquisition  &  Logistics  Management) 

•  Director,  Strategic  Systems  Programs  Office 

•  Deputy  Director,  Acquisition  Career  Management,  US  Army 

•  Defense  Business  Systems  Acquisition  Executive,  Business  Transformation  Agency 

•  Office  of  Procurement  and  Assistance  Management  Headquarters,  Department  of 
Energy 

We  also  thank  the  Naval  Postgraduate  School  Foundation  and  acknowledge  its 
generous  contributions  in  support  of  this  Symposium. 


James  B.  Greene,  Jr.  Keith  F.  Snider,  PhD 

Rear  Admiral,  U.S.  Navy  (Ret.)  Associate  Professor 


ACQUISITION  RESEARCH:  CREATING  SYNERGY  FOR  INFORMED  CHANGE  -  ii  - 


Panel  9  -  New  Dimensions  in  Acquisition 
Management 


Wednesday,  May  11,  2011 


1:45  p.m.  - 
3:15  p.m. 


Chair:  Joseph  L.  Yakovac  Jr.,  LTG,  USA,  (Ret.),  NPS;  former  Military  Deputy 
to  the  Assistant  Secretary  of  the  Army  (Acquisition,  Logistics,  &  Technology) 

Ship  Maintenance  Processes  with  Collaborative  Product  Lifecycle 
Management  and  3D  Terrestrial  Laser  Scanning  Tools:  Reducing  Costs 
and  Increasing  Productivity 

David  Ford,  Texas  A&M,  Thomas  Housel  and  Johnathan  Mun,  NPS 

Analysis  of  Alternatives  in  System  Capability  Satisficing  for  Effective 
Acquisition 

Brian  Sauser,  Jose  Ramirez-Marquez,  and  Weiping  Tan,  Stevens 
Institute  of  Technology 

Proposed  Methodology  for  Performance  Prediction  and  Monitoring  for  an 
Acknowledged  Systems  of  Systems 

Carly  Jackson  and  Rich  Volkert,  SSC  Pacific 


Joseph  L.  Yakovac  Jr. — Lt.  Gen.  Yakovac  retired  from  the  United  States  Army  in  2007,  concluding 
30  years  of  military  service.  His  last  assignment  was  as  director  of  the  Army  Acquisition  Corps  and 
Military  Deputy  to  the  Assistant  Secretary  of  Defense  for  Acquisition,  Logistics,  and  Technology.  In 
those  roles,  Lt.  Gen.  Yakovac  managed  a  dedicated  team  of  military  and  civilian  acquisition  experts  to 
make  sure  America’s  soldiers  received  state-of-the-art  critical  systems  and  support  across  a  full 
spectrum  of  Army  operations.  He  also  provided  critical  military  insight  to  the  Department  of  Defense 
senior  civilian  leadership  on  acquisition  management,  technological  infrastructure  development,  and 
systems  management. 

Previously,  Lt.  Gen.  Yakovac  worked  in  systems  acquisition,  U.S.  Army  Tank-Automotive  Command 
(TACOM),  and  in  systems  management  and  horizontal  technology  integration  for  the  Office  of  the 
Assistant  Secretary  of  the  Army  for  Acquisition,  Logistics,  and  Technology.  He  has  also  served  as 
executive  officer  and  branch  chief  for  the  Bradley  Fighting  Vehicle  and  as  a  brigade  operations  officer 
and  battalion  executive  officer,  U.S.  Army  Europe  and  U.S.  Army  Tank-Automotive  Command 
(TACOM). 

Lt.  Gen.  Yakovac  was  commissioned  in  the  infantry  upon  his  graduation  from  the  U.S.  Military 
Academy  at  West  Point.  He  served  as  a  platoon  leader,  executive  officer,  and  company  commander 
in  mechanized  infantry  units.  He  earned  a  Master  of  Science  in  Mechanical  Engineering  from  the 
University  of  Colorado  at  Boulder  before  returning  to  West  Point  as  an  assistant  professor. 

Lt.  Gen.  Yakovac  is  a  graduate  of  the  Armor  Officer  Advanced  Course,  the  Army  Command  and 
General  Staff  College,  the  Defense  Systems  Management  College,  and  the  Industrial  College  of  the 
Armed  Forces.  He  has  earned  the  Expert  Infantry  Badge,  the  Ranger  Tab,  the  Parachutist  Badge, 
and  for  his  service  has  received  the  Distinguished  Service  Medal,  the  Legion  of  Merit  three  times  and 
the  Army  Meritorious  Service  Medal  seven  times. 


ACQUISITION  RESEARCH:  CREATING  SYNERGY  FOR  INFORMED  CHANGE  -  265  - 


Ship  Maintenance  Processes  with  Collaborative  Product 
Lifecycle  Management  and  3D  Terrestrial  Laser  Scanning 
Tools:  Reducing  Costs  and  Increasing  Productivity 

David  Ford — Associate  Professor  of  Construction  Engineering  and  Management,  Zachry  Department 
of  Civil  Engineering,  Texas  A&M,  and  Research  Associate  Professor  of  Acquisition,  Graduate  School 
of  Business  and  Public  Policy,  NPS.  Dr.  Ford  has  also  held  a  faculty  position  at  the  University  of 
Bergen,  Norway.  He  received  his  doctorate  from  MIT  in  Dynamic  Engineering  Systems.  His  current 
research  interests  include  the  sustainability  of  engineered  systems,  the  use  of  real  options  for  risk 
management  and  policy  implementation,  tipping  point  dynamics,  project  management  and  control, 
and  the  management  of  professional  services  firms.  Dr.  Ford’s  research  work  has  been  published  in 
several  academic  journals,  including  IEEE  Transactions  on  Engineering  Management,  European 
Journal  of  Operations  Research,  System  Dynamics  Review,  Construction  Management  and 
Economics,  ASCE  Journal  of  Construction  Engineering  and  Management,  ASCE  Journal  of 
Management  in  Engineering,  and  Engineering  Construction  and  Architectural  Management.  He 
currently  serves  as  a  Managing  Editor  of  the  System  Dynamics  Review.  [DavidFord@tamu.edu] 

Thomas  Housel — Professor,  Information  Sciences,  Naval  Postgraduate  School.  Professor  Housel 
specializes  in  valuing  intellectual  capital,  knowledge  management,  telecommunications,  information 
technology,  value-based  business  process  re-engineering,  and  knowledge  value  measurement  in 
profit  and  non-profit  organizations.  His  current  research  focuses  on  the  use  of  knowledge-value 
added  (KVA)  and  real  options  models  in  identifying,  valuing,  maintaining,  and  exercising  options  in 
military  decision-making.  His  work  on  measuring  the  value  of  intellectual  capital  has  been  featured  in 
a  Fortune  cover  story  (October  3,  1994)  and  Investor’s  Business  Daily,  numerous  books,  professional 
periodicals,  and  academic  journals  (most  recently  in  the  Journal  of  Intellectual  Capital,  2005). 
[tjhousel@nps.edu] 

Johnathan  Mun — Professor  of  Research,  Information  Sciences  Department,  NPS.  Professor  Mun  is 
the  founder  and  CEO  of  Real  Options  Valuation,  Inc.,  a  consulting,  training  and  software  development 
firm  specializing  in  real  options,  employee  stock  options,  financial  valuation,  simulation,  forecasting, 
optimization,  and  risk  analysis  located  in  northern  California.  He  is  the  creator  of  the  Super  Lattice 
Solver  software,  Risk  Simulator  software,  and  Employee  Stock  Options  Valuation  software  at  the  firm. 
He  has  also  authored  numerous  books,  including  Real  Options  Analysis:  Tools  and  Techniques,  Real 
Options  Analysis  Course:  Business  Cases,  Applied  Risk  Analysis:  Moving  Beyond  Uncertainty,  and 
others,  [jcmun@nps.edu] 

Abstract 

The  current  cost-constrained  environment  within  the  federal  government  and  the 
Department  of  Defense  (DoD)  requires  a  defensible  approach  to  cost  reductions 
without  compromising  the  productivity  of  core  defense  processes.  Therefore, 
defense  leaders  today  must  maintain  and  modernize  the  United  States  Armed 
Forces  to  retain  technological  superiority  while  simultaneously  balancing  defense 
budget  cost  constraints  and  extensive  military  operational  commitments.  At  the  same 
time,  defense  leaders  must  also  navigate  a  complex  information  technology  (IT) 
acquisition  process.  The  DoD  spends  over  $63  billion  annually,  or  14%  of  its  total 
budget,  on  defense  maintenance  programs  throughout  the  world  (Office  of  the 
Deputy  Under  Secretary  of  Defense  [Logistics  and  Material  Readiness],  2006). 

One  such  core  process  that  is  central  to  naval  operations,  is  the  ship  maintenance 
process.  This  process  alone  accounts  for  billions  of  the  overall  Navy  annual  budget. 
There  have  been  a  series  of  initiatives  designed  to  reduce  the  cost  of  this  core 
process,  including  ship  maintenance  (SHIPMAIN),  which  was  designed  to 
standardize  ship  maintenance  alterations  in  order  to  take  advantage  of  the  cost- 
savings  learning  curve. 
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The  main  problem  in  SHIPMAIN  has  been  that  the  normal  cost-reduction  learning 
curve  for  common  ship  maintenance  items  across  a  series  of  ship  platforms  has  not 
yet  been  realized.  The  purpose  of  SHIPMAIN  was  to  take  advantage  of  this  cost- 
savings  learning  curve  over  time. 

This  study  suggests  that  unless  the  SHIPMAIN  process  employs  3D  Terrestrial  Laser 
Scanning  (3D  TLS)  and  collaborative  Product  Lifecycle  Management  (collab-PLM) 
tools,  SHIPMAIN  will  be  unlikely  to  obtain  the  learning  curve  benefits.  This  study 
uses  the  knowledge  value  added  (KVA)  +  systems  dynamics  (SD)  +  integrated  risk 
management  (IRM)  methodology  to  estimate,  analyze,  and  optimize  the  potential 
cost  savings  and  productivity  improvements  within  the  context  of  an  optimal  portfolio. 

Introduction 

The  current  cost-constrained  environment  within  the  federal  government  and  the 
Department  of  Defense  (DoD)  requires  a  defensible  approach  to  cost  reductions  without 
compromising  the  productivity  of  core  defense  processes.  Therefore,  defense  leaders  today 
must  maintain  and  modernize  the  United  States  Armed  Forces  to  retain  technological 
superiority  while  simultaneously  balancing  defense  budget  cost  constraints  and  extensive 
military  operational  commitments.  At  the  same  time,  defense  leaders  must  also  navigate  a 
complex  information  technology  (IT)  acquisition  process.  The  DoD  spends  over  $63  billion 
annually,  or  14%  of  its  total  budget,  on  defense  maintenance  programs  throughout  the  world 
(Office  of  the  Deputy  Under  Secretary  of  Defense  [Logistics  and  Material  Readiness],  2006). 

One  such  core  process  that  is  central  to  naval  operations,  is  the  ship  maintenance 
process.  This  process  alone  accounts  for  billions  of  the  overall  Navy  annual  budget.  There 
have  been  a  series  of  initiatives  designed  to  reduce  the  cost  of  this  core  process,  including 
ship  maintenance  (SHIPMAIN),  which  was  designed  to  standardize  ship  maintenance 
alterations  in  order  to  take  advantage  of  the  cost-savings  learning  curve. 

The  main  problem  in  SHIPMAIN  has  been  that  the  normal  cost-reduction  learning 
curve  for  common  ship  maintenance  items  across  a  series  of  ship  platforms  has  not  yet 
been  realized.  Figure  1  provides  a  notional  picture  of  this  phenomenon.  The  purpose  of 
SHIPMAIN  was  to  take  advantage  of  this  cost-savings  learning  curve  over  time. 

This  study  suggests  that  unless  the  SHIPMAIN  process  employs  3D  Terrestrial  Laser 
Scanning  (3D  TLS)  and  collaborative  Product  Lifecycle  Management  (collab-PLM)  tools, 
SHIPMAIN  will  be  unlikely  to  obtain  the  learning  curve  benefits.  This  study  uses  the 
knowledge  value  added  (KVA)  +  systems  dynamics  (SD)  +  integrated  risk  management 
(IRM)  methodology  to  estimate,  analyze,  and  optimize  the  potential  cost  savings  and 
productivity  improvements  within  the  context  of  an  optimal  portfolio.  As  demonstrated  in  the 
first  phase  of  this  study  using  KVA+SD+IRM,  the  potential  cost  savings  for  ship 
maintenance  processes  is  substantial  when  SHIPMAIN  incorporates  collab-PLM  and  3D 
TLS  tools.  The  use  of  these  tools  will  allow  the  SHIPMAIN  process  to  take  advantage  of  the 
normal  production  cost-savings  learning  curve. 
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Figure  1.  Learning  Curve  Before  and  After  SHIPMAIN 

The  inverse  learning  curve  (“Before  SHIPMAIN”)  results  in  cost  increases,  rather 
than  the  expected  cost  decreases  found  in  the  learning  curve  phenomena  in  all  other 
industries  (with  the  possible  exception  of  certain  software  firms’  products). 

SHIPMAIN  was  created,  in  part,  to  address  this  glaring  disparity  in  ship  maintenance 
performance  within  the  Navy.  However,  the  initial  instantiation  of  SHIPMAIN  did  not  include 
two  recommended  technologies:  that  is,  3D  TLS  +  collab-PLM,  which  were  deemed 
necessary  by  Bob  Stout,  the  creator  of  SHIPMAIN,  for  ensuring  the  success  of  the  new 
standardized  approach  (i.e.,  normal  learning  curve  cost  savings). 

These  technologies,  if  currently  employed  in  ship  building  and  continually  used  in  the 
maintenance  cycle,  should  lead  to  the  benefits  projected  in  this  study.  The  use  of  the  tools  in 
ship  building  will  allow  for  the  reuse  of  their  outputs  (i.e.,  3D  images  of  the  entire  ship  inside 
and  out  can  be  distributed  and  manipulated  remotely  by  a  wide  variety  of  vendors)  in  the 
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ship  maintenance  core  process.  Using  the  tools  across  the  entire  ship  building  and 
maintenance  lifecycle  should  result  in  substantial  cost  savings. 

To  evaluate  and  select  ship  maintenance  options  (e.g.,  use  of  the  collab-PLM  +  3D 
TLS  technologies)  that  promise  the  best  cost  savings  and  highest  returns,  measurement 
methods  are  essential  to  define,  capture,  and  measure  the  cost  savings  and  returns  on 
these  technologies.  In  addition  to  estimating  potential  cost  savings,  these  measurement 
methods  also  must  incorporate  and  analytically  quantify  elements  of  uncertainty  and  risks 
inherent  in  predicting  the  future  value  of  these  technologies.  This  will  allow  acquisition 
professionals  to  develop  ways  to  mitigate  these  risks  through  strategic  options,  and 
analytically  develop  and  allocate  budgets  to  optimize  project  portfolios. 

The  Naval  Postgraduate  School  (NPS)  developed  the  Knowledge  Value  Added  + 
Systems  Dynamics  +  Integrated  Risk  Management  (KVA+SD+IRM)  valuation  framework  to 
address  these  issues.  KVA+SD+IRM  analysis  is  designed  to  support  technology  portfolio 
acquisitions  and  to  empower  decision-makers  by  providing  performance-based  data  and  SD 
scenario  analysis.  With  historical  data  provided  by  KVA,  potential  strategic  investments  can 
then  be  evaluated  with  IRM  analysis. 

In  this  study,  the  KVA+SD+IRM  framework  is  used  to  quantify  process  cost  savings 
and  the  potential  benefits  of  selecting  collab-PLM+3D  TLS  technology  in  the  ship  SHIPMAIN 
program.  SHIPMAIN  is  a  large  program  with  many  interrelated  concepts,  instructions, 
policies,  and  areas  of  study.  Although  the  quantitative  scope  of  the  research  was 
constrained  to  Phases  IV  and  V  of  the  SHIPMAIN  process,  the  technologies  evaluated  in 
this  research  are  likely  to  provide  additional  benefits  (e.g.,  more  accurate  cost-estimation, 
higher  quality,  less  rework  and  more  efficient  system  dynamics)  across  all  phases  of 
SHIPMAIN. 

The  first  section  of  this  paper  explicates  the  KVA+SD+IRM  framework.  In  section 
two,  a  description  of  the  SHIPMAIN  program  is  provided.  The  third  section  describes  the 
collab-PLM+3D  TLS  technologies.  Following  this,  the  KVA+SD+IRM  framework  is  applied  to 
Phase  IV  of  SHIPMAIN  under  two  scenarios:  current  “As-ls”  and  potential  “To-Be”  (i.e., 
SHIPMAIN  supported  by  collab-PLM  +  3D  TLS).  Results  of  the  KVA  and  SD  scenario 
analysis  are  presented  with  the  implications  for  the  next  phase  of  the  research  where  IRM 
will  be  used  to  forecast  an  optimized  portfolio  controlling  for  risk. 

KVA  +SD+  IRM  Framework 

The  KVA+SD+IRM  framework  measures  operating  performance,  cost-effectiveness, 
return  on  investment,  risk  quantification,  strategic  real  options  (capturing  strategic  flexibility), 
and  analytical  portfolio  optimization.  The  use  of  SD  scenario  modeling  provides  a  means  to 
estimate  the  impact  of  SHIPMAIN  process  improvements  with  collab-PLM  +  3D  TLS 
technologies  over  time.  The  analysis  can  be  compared  with  historical  static  data  to  assess 
the  fidelity  of  the  SD  models. 

The  SD  scenario  results  provide  distributions  around  model  parameters  so  that  the 
IRM  analysis  can  be  based  on  distributions  of  parameter  estimates  instead  of  single-point 
estimates.  The  framework  then  can  provide  more  realistic  portfolio  optimization  to  evaluate 
the  technologies  in  terms  of  risks  while  taking  into  account  uncertainty  in  estimating  future 
benefits.  The  benefits  of  this  framework  include  the  following: 

■  provides  high  fidelity  models  of  potential  cost  savings  and  value  of  specific 
processes,  functions,  departments,  divisions,  or  organizations  in  common 
units; 
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■  provides  scenario  models  based  on  historical  data  in  terms  of  costs  and 
benefits  of  specific  processes  and  tasks  for  programs  or  organizations; 

■  helps  meet  regulatory  compliance  guidelines  (such  as  the  Clinger-Cohen  Act 
of  1996)  mandating  portfolio  management  for  federal  agencies; 

■  highlights  current  operational  cost  inefficiencies,  as  well  as  potential  cost 
avoidance;  and 

■  improves  current  and  potential  portfolio  investments  by  estimating  potential 
total  value  created. 

KVA+SD  provides  the  data  sets  for  estimating  potential  cost  savings  based  on  the 
target  technologies  that  can  be  used  in  estimating  the  strategic  flexibility  options  value  of 
these  technologies,  as  well  as  providing  the  data  required  for  a  rigorous  quantitative  portfolio 
optimization  analysis.  Management  can  drill  down  to  understand  the  cost  of  each  process 
from  a  common  reference  point  as  well  as  the  potential  cost-savings  contributions  to  the 
bottom  line  using  the  KVA+SD+IRM  framework.  The  Navy  acquisitions  community  can  use 
the  framework  to  enhance  existing  cost  analysis  tools,  as  well  as  to  value  specific 
operations,  such  as  ship  maintenance  or  ship  building. 

SHIPMAIN 

In  August  2006,  the  Surface  Ship  and  Carrier  Entitled  Process  for  Modernization 
(SSCEPM)  Management  and  Operations  Manual  became  the  Navy’s  official  document  for 
the  modernization  of  all  Surface  Ships  and  Aircraft  Carriers  (Commander,  Naval  Sea 
Systems  Command,  2006).  SSCEPM  provides  the  policy  and  processes  associated  with 
SHIPMAIN  for  planning,  budgeting,  engineering,  and  installing  timely  effective  and 
affordable  shipboard  improvements  while  maintaining  configuration  management  and 
supportability.  The  SHIPMAIN  process  represents  a  sweeping  change  in  the  modernization 
of  Surface  Ships  and  Carriers.  The  SHIPMAIN  process  streamlines  and  consolidates  a 
number  of  existing  modernization  practices,  processes,  meetings,  and  supporting 
documents  to  provide  a  single,  hierarchical  decision-making  process  for  modernizing 
Surface  Ships  and  Carriers. 

The  SHIPMAIN  process  comprises  five  distinct  phases1  and  three  Decision  Points 
(DP)2  that  take  a  proposed  change  from  concept  to  completion  in  a  single  Ship  Change 
Document  (SCD).  The  SCD  is  a  single  lifecycle-management  document  depicting  a 
modernization  change  from  concept  to  completion  for  ships  (Commander,  Naval  Sea 
Systems  Command,  2006,  §  3,  p.  3-2).  Although  SHIPMAIN  has  a  functional  governance 
structure  and  supporting  business  rules,  it  has  yet  to  reach  a  fully  implemented  state, 
especially  in  Phases  IV  and  V.  Business  rules  for  Phases  IV  and  V  are  in  a  maturing  phase, 
and  the  process  owners  are  regularly  gathering  input  from  stakeholders  to  resolve  issues 
and  refine  the  business  rules  in  order  to  move  forward  with  this  initiative. 

SHIPMAIN  is  designed  to  take  advantage  of  best  business  practices  from  industry 
that  lead  to  cost  reductions  based  on  the  production  learning  curve.  The  Navy  implemented 
the  SHIPMAIN  process  in  FY  2004  to  do  the  following: 

■  increase  efficiency  of  maintenance  and  modernization  process  without 
compromising  effectiveness; 


1  Five  Phases:  l-Conceptual,  11-Preliminary  Design,  Ill-Detailed  Design,  IV-Implementation,  V-lnstallation 
(Commander,  Naval  Sea  Systems  Command,  2006). 

2  DPs  occur  at  the  conclusion  of  Phases  l-lll.  Each  DP  is  an  approval  for  funding  of  successive  phases  and  has 
an  associated  Cost  Benefit  Analysis  (CBA),  Alteration  Figure  of  Merit  (AFOM),  and  Recommended  Change 
Package  (RCP;  Commander,  Naval  Sea  Systems  Command,  2006). 
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■  define  common  planning  process  for  surface  ship  maintenance  and 
alterations; 

■  install  a  disciplined  management  process  with  objective  measurements;  and 

■  institutionalize  that  process  and  provide  continuous  improvement 
methodology  (Commander,  Naval  Sea  Systems  Command,  2006). 

SHIPMAIN  seeks  to  identify  and  eliminate  redundancies  in  maintenance  processes. 

It  provides  a  single  entitled  process,  assisting  the  Navy  in  realizing  the  maximum  cost 
savings  in  maintenance  by  eliminating  time  lags,  prioritizing  ship  jobs,  and  empowering 
Sailors  in  their  maintenance  decisions  (Commander,  Naval  Sea  Systems  Command,  2006). 
The  five-phase  process  was  originally  designed  to  employ  collab-PLM  +  3D  TLS.  However, 
these  technologies  were  not  incorporated  in  the  implementation  of  the  SHIPMAIN  program. 
This  study  examines  the  potential  cost  savings  and  productivity  improvements  that  would 
feed  an  IRM  portfolio  optimization  analysis  when  these  two  technologies  are  used  to  support 
the  SHIPMAIN  processes.  The  SD  models  compare  the  SHIPMAIN’s  Phase  Four  process 
with  and  without  the  supporting  technology  to  determine  the  potential  long-term  cost 
savings. 

3D  Terrestrial  Laser  Scanning  Technology 

Terrestrial  Laser  Scanning  technology  is  currently  used  in  a  variety  of  industries. 
According  to  industry  analysts,  laser  scanner  manufacturers  and  related  software  and 
service  providers  report  strong  activity  across  many  markets,  including  the  following: 
shipbuilding,  offshore  construction  and  repair,  onshore  oil  and  gas,  fossil  and  nuclear  power, 
civil  and  transportation  infrastructure,  building,  automotive  and  construction  equipment, 
manufacturing,  and  forensics  (Greaves  &  Jenkins,  2007,  para.  1).  Sales  of  3D  Terrestrial 
Laser  Scanning  hardware,  software,  and  services  reached  $253  million  in  2006 — a  growth 
of  43%  over  2005  (Greaves  &  Jenkins,  2007). 

Most  manufacturers’  scanners  work  by  scanning  a  target  space  with  a  laser  light 
mounted  on  a  highly  articulating  mount,  enabling  data  capture  in  virtually  any  orientation 
with  minimal  operator  input.  Some  also  incorporate  a  digital  camera  that  simultaneously 
captures  a  360°  field-of-view  color  photo  image  of  the  target.  Once  the  capture  phase  is 
complete,  the  system  automatically  executes  proprietary  point-processing  algorithms  to 
process  the  captured  image.  The  system  can  generate  an  accurate3  digital  3D  model  of  the 
target  space,  automatically  fuse  image  texture  onto  3D  model  geometry,  export  file  formats 
ready  for  commercial,  high-end  design,  and  import  them  into  2D/3D  Computer-aided  Design 
(CAD)  packages. 

Collaborative  Product  Lifecycle  Management  Technology 

Collab-PLM  technology  provides  a  common  platform  to  electronically  integrate  3D 
TLS  images  in  three  dimensional  surface  representations  to  enable  collaboration  among  all 
parties  involved  in  a  given  project  regardless  of  their  geographic  location.  It  also  provides  a 
means  to  store  the  images  and  all  related  maintenance  work  within  a  common  database 
accessible  by  all  participants  in  a  ship  alteration  or  modernization  project. 

PLM  is  defined  by  ClMdata  as  a  strategic  business  approach  applying  a  consistent 
set  of  business  solutions  in  support  of  the  collaborative  creation,  management, 


3  NSRP’s  study  (2006  &  2007b)  requirement  was  within  3/16  of  an  inch  to  actual  measurements. 
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dissemination,  and  use  of  product  definition  information  across  the  extended  enterprise, 
from  concept  to  end  of  life.4  It  integrates  people,  processes,  and  information. 


The  collab-PLM  tools  include  technologies  that  support  data  exchange,  portfolio 
management,  digital  manufacturing,  enterprise  application  integration,  and  workflow 
automation.  A  range  of  industries  have  invested  in  collab-PLM  solutions,  including  those 
involved  in  aerospace  and  defense,  automotive  and  transportation,  utilities,  process 
manufacturing,  and  high-tech  development  and  manufacturing.  The  collab-PLM  market  is 
poised  for  further  growth  with  vendors  expanding  product  offerings  as  the  industry  evolves. 
Figure  2  indicates  the  evolution  of  PLM  applications,  illustrating  their  stages  before  reaching 
the  “plateau  of  productivity”  in  the  mainstream  market. 
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Figure  2.  Evolution  of  PLM 

(Halpern  &  Smith,  2004)The  assimilation  of  3D  Terrestrial  Laser  Scanning  and  Product 
Lifecycle  Management  technologies  into  Phases  IV  and  V  of  SHIPMAIN  could  be  the  key  to 
the  Navy’s  goal  of  reducing  costs  while  still  maintaining  a  superior  level  of  effectiveness. 
The  KVA+SD+IRM  valuation  framework  can  be  applied  to  quantify  the  potential  impact  of 
these  technologies  on  the  SHIPMAIN  directive  by  comparing  “As-ls”  and  “To-Be”  scenarios. 


4  ClMdata  is  a  consulting  firm  with  over  20  years  of  experience  in  strategic  IT  applications  and  is  an 
acknowledged  leader  in  the  application  of  PLM  and  related  technologies  (ClMdata,  2007a). 
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SHIPMAIN:  With  and  Without  Collab-PLM+3D  TLS  Technologies 

The  KVA+SD+IRM  valuation  framework  will  be  used  to  demonstrate  how  the 
integration  of  these  two  technologies  within  Phase  IV  of  SHIPMAIN  could  result  in 
substantial  cost  savings  and  decreased  fleet  cycle  time  via  significant  productivity 
improvements. 

A  prior  study  of  the  ship  maintenance  process  (Komoroski,  2005)  identified  seven 
sequential  processes  utilized  to  plan  for  ship  maintenance  alterations  on  U.S.  Navy  surface 
ships,  shown  in  Figure  3.  An  “As-ls”  environment  without  collab-PLM+3D  TLS  technologies 
was  modeled  to  develop  the  baseline  cost  and  productivity  data  using  the  KVA  method.5 


Figure  3.  Planning  Yard  Core  Processes 

(Komoroski,  2005,  p.  36) 

The  baseline  costs  for  these  Phase  IV  processes  was  estimated  to  be  $45  million  per 
year6  to  execute  the  shipyard  planning  process  cycle  40  times  across  the  four  public 
shipyards.  Adding  3D  laser  scanning  to  the  planning  process  cycle  lowered  expenses  a 
projected  84%  (to  less  than  $8  million),  as  seen  in  Table  1 .  Introduction  of  3D  laser  scanning 
in  the  “To-Be”  environment  could  result  in  projected  cost  savings  of  nearly  $37  million 
because  Subprocesses  3,  4,  and  7  were  re-engineered  (Komoroski,  Housel,  Horn,  &  Mun, 
2006). 

The  second  notional  environment  “To-Be”  evaluated  the  effects  of  adding  3D  laser 
scanning  and  the  collaborative  PLM  suite  of  software  to  the  “As-ls”  baseline.  Projections  for 
this  scenario  (based  from  increased  savings  in  Subprocesses  3,  4,  and  7,  as  well  as 
additional  savings  realized  in  Subprocesses  2  and  5)  included  a  cost  savings  of  90%  or 
approximately  $40  million. 


5  Baseline  data  for  As-ls  environment  was  compiled  by  conducting  extensive  interviews  with  SMEs  of  the  Puget 
Sound  Planning  Yard. 

6  The  baseline  costs  were  based  on  the  execution  of  the  shipyard  planning  process  cycle  40  times  across  the 
four  public  shipyards  per  year. 
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Table  1. 


KVA  Results — Analysis  of  Costs 

(Komoroski  et  al.,  2006,  p.  36) 


Process  Title 

“AS-IS” 

1 

ISSUE  TASKING 

$173,500 

2 

INTERPRET  ORDERS 

$520,000 

3 

PLAN  FOR  SHIP  CHECK 

$1,655,000 

4 

CONDUCT  SHIP  CHECK 

$2,604,500 

5 

REPORT  ASSEMBLY 

$235,000 

6 

REVISE  SCHEDULE 

$131,000 

7 

GENERATE  DRAWINGS 

$39,386,000 

TOTALS 

$44,705,000 

KVA  Results 

The  cost  analysis  results  were  based  on  the  “As-ls”  KVA  baseline  analysis.  The 
return  on  investment  (ROI)  analysis  is  presented  in  Table  2. 


Table  2.  KVA  Results — Analysis  on  ROI 


Core  Process 

Process  Title 

"AS-IS"  ROI 

1 

Issue  Tasking 

-69% 

2 

Interpret  Orders 

518% 

3 

Plan  for  Ship  Check 

-99% 

4 

Conduct  Ship  Check 

552% 

5 

Report  Assembly 

783% 

6 

Revise  Schedule 

1375% 

7 

Generate  Drawings 

-37% 

This  baseline  model  provided  the  inputs  for  the  SD  model.  A  comparison  with  the  SD 
model  and  the  static  KVA  analysis  revealed  that  the  SD  model  was  of  high  fidelity  and  could 
be  used  to  iterate  parameters  for  further  analysis  of  the  “To-Be”  scenarios  using  time 
periods  and  the  effects  of  the  two  technologies.  While  these  results  might  be  considered 
relatively  positive,  the  addition  of  collab-PLM+3D  TLS  technologies  promise  to  return  even 
more  significant  savings. 

Systems  Dynamics  Model  and  Results 

The  SD  model  was  initially  used  to  improve  estimates  of  cost  savings  through  the 
implementation  of  collab-PLM+3D  TLS  technologies.  The  model  structure  reflects  the  set  of 
serial  core  processes  shown  in  Figure  3.  Like  the  previous  KVA  analysis  of  SHIPMAIN,  the 
SD  model  simulates  the  28  subprocesses  that  can  be  clustered  into  those  seven  core 
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processes.  The  impacts  of  the  subprocesses  were  aggregated  for  the  current  cost-savings 
estimates.  Analysis  at  the  core  process  and  subprocess  level  of  aggregation  will  be  part  of 
the  future  work  to  be  described  later. 

In  the  model,  each  subprocess  can  be  constrained  by  either  the  resources  provided 
(e.g.,  headcount  of  workforce  applied  to  the  subprocess)  or  the  availability  of  work.  Previous 
KVA  modeling  of  SHIPMAIN  assumed  steady  state  conditions  for  one  year.  Under  these 
conditions,  work  availability  does  not  constrain  progress.  However,  under  the  changing  and 
uncertain  conditions  that  better  reflect  actual  circumstances,  the  availability  of  work  can 
significantly  impact  performance.  For  example,  if  the  number  of  ships  entering  the  yard 
drops  below  some  level,  certain  subprocesses  could  complete  the  work  on  all  the  ships  in 
the  yard  that  are  available  and  will  be  left  idle.  Conditions  such  as  these  will  be  modeled 
with  the  SD  model  for  the  Integrated  Risk  Management  portion  of  the  research,  as  described 
later.  Steady  state  conditions  were  assumed  for  the  cost-saving  investigation  described 
here. 


Several  factors  that  impact  SHIPMAIN  benefits  and  costs  that  were  not  included  in 
the  previous  work  but  can  significantly  impact  cost  savings  were  incorporated  into  the  SD 
model.  Model  improvements  that  impacted  benefits  include  the  following: 

■  variation  in  the  number  of  ships  that  are  in  the  process  of  adopting  of 
PLM+3D  TLS  in  larger  numbers  of  shipyards; 

■  increase  in  number  of  ships  that  can  be  processed  through  the  yards  if 
PLM+3D  TLS  are  adopted  due  to  the  reduced  cycle  time  of  individual  ships 
with  PLM+3D  TLS;  and 

■  lifespan  of  the  use  of  PLM+3D  TLS  in  the  shipyards  before  adoption  of  a  new 
technology. 

Model  changes  that  improved  the  accuracy  of  cost  estimates  include  the  following: 

■  average  costs  of  common  units  of  output  (CUO)7  in  $/CUO  were  calculated; 

■  initial  costs  to  purchase  collaborative  PLM  software  and  license  users  were 
included;  and 

■  costs  to  install  3D  imaging  equipment  at  the  shipyards  using  3D  TLS  were 
included. 

Cost  savings  were  calculated  as  follows: 


H 


where, 

77=  cost  savings, 

v  =  volume  of  benefits  generated,  and 
X  =  unit  cost  savings. 

In  other  words,  the  cost  savings  is  equal  to  volume  of  benefits  generated  multiplied 
by  the  unit  cost  savings.  Volume  of  benefits  generated  is  the  number  of  common  units  of 
output  (CUO)  produced  under  the  adoption  (“To-Be”)  scenario. 
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Awo  =  denotes  SHIPMAIN  unit  cost  without  PLM+3D  TLS  (“As-ls”)  scenario,  and 
Aw  =  denotes  SHIPMAIN  unit  cost  with  PLM+3D  TLS  (“To-Be”)  scenario. 

Unit  costWo  =  Process  Costwo  /  CUO  generatedwo 
Unit  costw  =  Process  Costw  /  CUO  generatedw 

For  both  the  “with”  (w  subscript)  and  “without”  (wo  subscript)  conditions: 

Process  Cost  =  Initial  System  Costs  +  Operations  Costs,  and 

Initial  System  Costs  =  Software  purchase  and  installation  cost  +  (3D  TLS  installation 
per  yard  cost)  *  (Yards  adopting  PLM+3D  TLS). 

The  software  purchase  and  installation  cost  (estimated  to  be  $1.6  million)  was  amortized 
evenly  over  the  product  life  span.  The  cost  of  installing  the  3D  TLS  in  a  yard  (estimated  to 
be  $80,000  per  yard)  was  amortized  evenly  over  the  first  year  of  use. 

Operations  Costs  =  XufespanZsubprocesses  (Subprocess  Headcount  *  Daily  salary  * 
Subprocess  duration  *  Shipcheck  rate) 

CUO  generated  =  Zsubprocesses  (Shipcheck  subprocessing  rate  *  (Operator  Knowledge 
applied/shipcheck  +  IT  Knowledge  applied/shipcheck)) 

IT  Knowledge  applied/shipcheck  =  (Subprocess  fraction  performed  by  IT  *  Operator 

Knowledge  applied/shipcheck) 

Shipcheck  subprocessing  rate  =  Current  subprocessing  rate  *  Increase  due  to  cycle 

time  reduction 

Current  (i.e.,  without  collaborative  PLM  +  3D  TLS)  subprocessing  rates,  headcounts, 
durations,  and  fractions  performed  by  IT  were  developed  based  on  information  collected 
from  subject-matter  experts  as  part  of  the  previous  KVA  research  by  Komoroski  (2005). 
Estimates  of  the  software  purchase  and  installation  cost  and  installation  costs  of  the  3D  TLS 
systems  in  shipyards  was  collected  as  part  of  the  current  research  in  spring  201 1  from  a 
vendor  representative.  The  vendor  representative  also  reported  that  other  industries 
experience  reductions  in  cycle  time  (in  the  current  study  this  would  be  average  ship 
processing  duration)  ranging  from  20%  to  60%.  Increases  in  Current  subprocessing  rates 
were  calculated  from  these  values  using  Little’s  Law  (Sterman,  2000),  which  states  (using 
SHIPMAIN  concepts)  that,  averaged  across  many  processing  durations,  under  steady  state 
conditions: 

Ships  in  yard  =  ship  flow  through  the  yard  *  average  ship  process  duration. 

For  example,  if  the  four  Navy  yards  alter  40  ships/year  and  each  ship  requires  an 
average  of  3  months  (=0.25  years)  to  alter,  the  four  yards  have  a  capacity  to  work  on  10 
ships  at  a  time: 

10  ships  =  40  ships/year  *  0.25  years 


7  Common  units  of  output  (CUO)  are  the  measure  of  benefits  developed  in  the  Knowledge  Value  Analysis  (KVA) 
methodology  and  reflect  the  amount  of  knowledge  applied  in  each  performance  of  a  subprocess. 
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If  the  adoption  of  collaborative  PLM  and  3D  TLS  reduces  the  average  ship 
processing  duration  by  20%  to  2.4  months  (=0.20  years)  and  the  four  yards  retain  the  same 
capacity  (10  ships), 

10  ships  =  50  ships/year  *  0.20  years 

This  represents  a  25%  increase  in  processing,  which  is  reflected  in  the  model  with  an 
increase  due  to  cycle  time  reduction  equal  to  1 .25  (50  ships  per  year  /  40  ships  per  year). 
Similarly,  a  60%  reduction  in  cycle  time  generates  a  150%  increase  in  processing  and  an 
increase  due  to  cycle  time  reduction  equal  to  2.50. 

10  ships  =  100  ships/year  *  (3*0.40)/12) 

100  ships  per  year/40  ships  per  year  =  2.50 


Model  Testing 

The  model  was  tested  with  standard  tests  of  model  validation  used  to  assess  SD 
models  (Sterman,  2000),  including  structural  similarity  to  the  actual  system,  unit  consistency, 
realistic  behavior  under  extreme  conditions,  and  similarity  of  simulated  performance  with 
previous  models  (KVA  analysis  by  Komoroski,  2005,  in  this  case).  Return  on  Knowledge 
(ROK)  values  for  the  28  subprocesses  as  simulated  are  shown  in  Table  3.  (ROK  represents 
a  basic  productivity  performance  measure  and  is  proportionate  to  ROI.  The  only  difference 
is  that  ROK  =  Revenue/Cost  and  ROI  =  Revenue-Cost/Cost.) 

The  values  in  Table  3  match  those  generated  by  the  previous  KVA  analysis  for  the 
same  conditions  (Komoroski,  2005),  supporting  the  ability  of  the  SD  model  to  generate 
realistic  performance  measures.  Based  on  these  tests,  the  model  was  found  to  reflect  the 
actual  system  adequately  for  use  in  investigating  cost  savings  due  to  the  adoption  of 
collaborative  PLM  and  3D  TLS  by  SHIPMAIN  processes. 
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Table  3.  Simulated  SHIPMAIN  Return  on  Knowledge  for  Subprocesses 


Subprocess 

No. 

Subprocess  Description 

Annual 

Benefits 

(CUO) 

Annual 
Costs  ($) 

Return  on 
Knowledge 
(ROK) 

la. 

Plan  SHIPCHECK  budget  allocations. 

52.00 

54,219.87 

0.00 

1b. 

Coordinate  and  build  schedule. 

52.00 

32,531.98 

0.00 

1c. 

PLM  oversee  entire  task. 

35,880.00 

86,751.96 

0.41 

2a. 

Coordinate  and  communicate  with  follow 
codes  and  outside  organizations. 

720,000.56 

56,550.11 

12.73 

2b. 

Begins  data  collection  pertaining  to  tasking. 

1,380,000.00 

135,550.38 

10.18 

2c. 

Create  Job  Information  Sheet  (JIS)  for  each 
unique  "job." 

672,001.38 

135,550.38 

4.96 

3a. 

Form  shipcheck  team. 

84.00 

5,422.00 

0.02 

3b. 

Get  permission  to  go  to  ship. 

200.00 

2,711.00 

0.07 

3c. 

Gather  data  applicable  to  shipcheck:  review 
guidance,  drawings,  schematics 

19,320.00 

339,300.25 

0.06 

3d. 

Physically  gather  tools  required  for 
SHIPCHECK. 

40.00 

27,144.04 

0.00 

4a. 

Travel  time.  Transport  team  to  ship. 

40.00 

135,719.91 

0.00 

4b. 

Manage  overall  process. 

52,900.00 

54,219.87 

0.98 

4c. 

Conduct  in-brief  and  out-brief  with  ship's 

crew. 

21,160.00 

2,711.00 

7.81 

4d. 

Liason  with  ship's  crew,  including  conflict 
management  and  resolution. 

1,379,999.88 

43,375.98 

31.81 

4e. 

Conduct  ship  walkthru:  identify  and  resolve 
interferences  between  new  installations 

4,139,999.75 

90,479.88 

45.76 

4f. 

Determine  alteration-pertinent  capacities. 

184,800.20 

226,200.42 

0.82 

4g. 

Collect  "removal  data"  for  equipment  and 
material  to  be  removed 

35,999.99 

90,479.88 

0.40 

4h. 

Scan  &  capture  point  cloud  images  for 
applicable  areas  and  compartments. 

10,763,999.00 

45,239.94 

237.93 

4i. 

Photograph  images  for  SHIPALTS  with  digital 

camera. 

17,500.01 

36,192.07 

0.48 

4j. 

Create  SHIPALT  material  lists. 

1,655,999.88 

180,959.77 

9.15 

4k. 

Travel  time.  Transport  team  from  ship. 

40.00 

135,719.91 

0.00 

5a. 

Determine  and  list  conflicts  between 
subsystems. 

1,379,999.88 

113,100.21 

12.20 

5b. 

Create  SHIPALT  Report. 

3,239.99 

9,048.02 

0.36 

6a. 

Organize  data  to  update  DIS. 

1,287,999.88 

113,100.21 

11.39 

6b. 

Develop  drawing  "list"  or  schedule. 

144.00 

9,048.02 

0.02 

6c. 

Expected  manhours  determined. 

144.00 

9,048.02 

0.02 

7b. 

Conduct  data  processing  for  captured  point 
clouds 

18,215,998.00 

271,439.81 

67.11 

7c. 

Model  processed  data  to  3D. 

28,979,998.00 

2,035,794.75 

14.24 

7d. 

Generate  2D  drawings. 

24,149,998.00 

11,309.99 

2,135.28 

Collaborative  PLM  and  3D  TLS  Adoption  Conditions  and  Simulation  Results 

SHIPMAIN  was  simulated  with  the  SD  model  by  varying  three  conditions.  Three 
adoption  scenarios  were  simulated,  as  follows: 

1 .  no  adoption  of  collaborative  PLM  and  3D  TLS,  reflecting  “As-ls”  conditions; 


NFS 
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2.  adoption  by  the  four  Navy  shipyards;  and 

3.  adoption  by  the  four  Navy  shipyards  plus  three  commercial  shipyards. 

Three  product  life  spans  were  simulated:  5,  10,  and  15  years.  Three  levels  of  cycle 
time  reduction  were  simulated:  20%,  40%,  and  60%.  The  resulting  cost  savings  are  shown 
in  Table  4  and  Figure  4. 


Table  4.  Simulated  SHIPMAIN  Cost  Savings  Due  to  Adoption  of  Collaborative 

PLM  and  3D  TLS 


Shipmain 
Cost  Savings 
(*$1,000,000) 

Seal 
4  yards, 
20%  CT 
reduction 

e  of  Adop 
4  yards, 
40%  CT 
reduction 

>tion  and 
4  yards, 
60%  CT 
reduction 

Cycle  Tir 

7  yards, 
20%  CT 
reduction 

ne  Reduc 
7  yards, 
40%  CT 
reduction 

:tion 

7  yards, 
60%  CT 
reduction 

Product 

Life 

5  years 

$776 

$1,038 

$1,559 

$1,362 

$1,819 

$2,731 

1 0  years 

$1,555 

$2,076 

$3,121 

$2,726 

$3,639 

$5,465 

1 5  years 

$2,333 

$3,116 

$4,680 

$4,091 

$5,461 

$8,199 

4  yards,  20%  CT  4  yards,  40%  CT  4  yards,  60%  CT  7  yards,  20%  CT  7  yards,  40%  CT  7  yards,  60%  CT 

reduction  reduction  reduction  reduction  reduction  reduction 


Figure  4.  Simulated  SHIPMAIN  Cost  Savings  ($millions)  Due  to  Adoption  of 

Collaborative  PLM  and  3D  TLS 

Net  estimated  cost  savings  potential  by  adopting  collaborative  PLM  and  3D  TLS  is 
very  large,  ranging  from  $776  million  to  well  over  $8  billion.  As  expected,  cost  savings 
increase  with  the  number  of  yards  adopting  collaborative  PLM  and  3D  TLS,  product  life 
span,  and  the  size  of  the  reduction  in  cycle  time. 

Several  modeling  assumptions  can  create  differences  between  estimated  and  actual 
cost  savings.  One  of  these  assumptions  is  the  amortization  of  the  initial  cost  over  the 
product  life  span  and  the  amortization  of  the  yard  installation  costs  over  a  year.  Paying 
these  costs  at  the  time  of  adoptions  would  reduce  initial  savings  and  increase  savings  later, 
relative  to  the  simulated  values.  More  importantly,  sharing  the  use  of  these  technologies 
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with  the  design  and  construction  of  new  ships  would  share  their  cost  with  those  processes 
and  significantly  increase  SHIPMAIN  cost  savings. 

A  second  modeling  assumption  that  can  impact  estimated  savings  concerns  the 
volume  of  ships  being  altered.  In  the  model,  the  volume  is  determined  by  the  assumed 
steady  state  flow  and  impact  of  cycle  time  reduction.  As  documented  and  described  by 
Komoroski  (2005),  ship  alteration  volumes  can  vary  due  to  external  events  (e.g.,  war),  fleet 
conditions,  and  other  factors.  Cycle  time  reductions  cannot  be  accurately  determined  until 
the  improved  technologies  are  installed  and  operational.  The  range  of  simulated  values  is 
believed  to  reflect  a  realistic  envelop  of  possible  conditions.  Finally,  the  model  assumes  that 
all  of  the  yards  that  adopt  the  technology  adopt  it  at  the  same  time  and  fully  capture  its 
benefits  immediately.  In  practice,  there  might  be  a  rolling  out  of  collaborative  PLM  and  3D 
TLS,  beginning  in  one  or  more  years  to  learn  how  to  best  exploit  its  capabilities,  followed  by 
wider  adoption  by  other  shipyards.  In  total,  these  differences  between  practice  and  the 
modeling  assumptions  are  expected  to  reduce  savings,  particularly  early  in  adoption. 
Additional  models  can  relax  these  assumptions  and  generate  more  detailed  savings  profiles. 
Regardless,  the  size  of  the  potential  savings  justifies  the  adoption  of  collaborative  PLM  and 
3D  TLS. 

Integrated  Risk  Management  Analysis:  Strategic  Real  Options 

The  results  for  the  IRM  analysis  will  be  built  on  the  quantitative  estimates  provided 
by  the  KVA+SD  analysis.  The  IRM  will  provide  a  defensible  quantitative  risk  analytics  and 
portfolio  optimization  suggesting  the  best  way  to  allocate  limited  resources  to  ensure  the 
highest  possible  cost  savings  over  time  in  ship  maintenance  processes.  The  first  step  in  real 
options  is  to  generate  a  strategic  map  through  the  process  of  framing  the  problem.  Based  on 
the  overall  problem  identification  occurring  during  the  initial  qualitative  management 
screening  process,  certain  strategic  options  would  have  become  apparent  for  each 
particular  project.  The  strategic  options  may  include  among  other  things,  the  option  to 
expand,  contract,  abandon,  switch,  choose,  and  so  forth. 

Through  the  use  of  Monte  Carlo  simulation,  the  resulting  stochastic  KVA  ROK  model 
will  have  a  distribution  of  values.  Thus,  simulation  models,  analyzes,  and  quantifies  the 
various  risks  of  each  project.  The  result  is  a  distribution  of  the  ROKs  and  the  project’s 
volatility.  In  real  options,  we  assume  that  the  underlying  variable  is  the  future  benefit  minus 
cost  of  the  project.  An  implied  volatility  can  be  calculated  through  the  results  of  a  Monte 
Carlo  simulation  performed.  Usually,  the  volatility  is  measured  as  the  annualized  standard 
deviation  of  the  logarithmic  relative  returns  on  the  free  net  benefit  stream. 

Portfolio  optimization  is  the  next  step  in  the  analysis.  If  the  analysis  is  done  on 
multiple  projects  or  processes,  decision-makers  should  view  the  results  as  a  portfolio  of 
rolled-up  projects  because  the  projects  are  in  most  cases  correlated  with  one  another,  and 
viewing  them  individually  will  not  present  the  true  picture.  As  organizations  do  not  only  have 
single  projects,  portfolio  optimization  is  crucial.  Given  that  certain  projects  are  related  to 
others,  there  are  opportunities  for  hedging  and  diversifying  risks  through  a  portfolio. 

Because  firms  have  limited  budgets,  along  with  time,  people,  and  resource  constraints, 
while  at  the  same  time  have  requirements  for  certain  overall  levels  of  returns,  risk 
tolerances,  and  so  forth,  portfolio  optimization  takes  into  account  all  these  to  create  an 
optimal  portfolio  mix.  The  analysis  will  provide  the  optimal  allocation  of  investments  across 
multiple  projects. 

Risk  analysis  assumes  that  the  future  is  uncertain  and  that  decision-makers  have  the 
right  to  make  midcourse  corrections  when  these  uncertainties  become  resolved  or  risks 
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distributions  become  known;  the  analysis  is  usually  done  ahead  of  time  and  thus,  ahead  of 
such  uncertainty  and  risks.  Therefore,  when  these  risks  become  known,  the  analysis  should 
be  revisited  to  incorporate  the  information  in  decision  making  or  revising  any  input 
assumptions.  Sometimes,  for  long-horizon  projects,  several  iterations  of  the  real  options 
analysis  should  be  performed,  where  future  iterations  are  updated  with  the  latest  data  and 
assumptions.  Understanding  the  steps  required  to  undertake  an  integrated  risk  analysis  is 
important  because  it  provides  insight  not  only  into  the  methodology  itself,  but  also  into  how  it 
evolves  from  traditional  analyses,  showing  where  the  traditional  approach  ends  and  where 
the  new  analytics  start. 

Real  options  analysis  will  be  performed  to  determine  the  prospective  value  of  the 
basic  options  over  a  multi-year  period  using  KVA  data  as  a  platform.  The  strategic  real 
options  analysis  is  solved  using  various  methodologies,  including  the  use  of  binomial  lattices 
with  market  replicating  portfolios  approach  and  backed  up  using  a  modified  closed-form 
sequential  compound  option  model.  The  value  of  a  compound  option  is  based  on  the  value 
of  another  option.  That  is,  the  underlying  variable  for  the  compound  option  is  another  option, 
and  the  compound  option  can  either  be  sequential  in  nature  or  simultaneous.  Solving  such  a 
model  requires  programming  capabilities. 

For  instance,  we  first  start  by  solving  for  the  critical  value  of  I,  an  iterative  component 
in  the  model  using 


X2=Ie 


- qiT2-h ) 


<D 


^  ln(7 1  X^  +  ir-q  +  cr2 1 2)(T2 -r,)A 
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Then,  solve  recursively  for  the  value  /  above  and  input  it  into  the  model: 

'in  (S/XJ  +  ir-q  +  a2 /2)T2 

Compound  Option  =  Se  qr‘Cl 


<y^r2 

In  (5//)  +  (r-g  +  <72/2X 


-X,e  rT2Q 


—  X2e‘Q 


ln(5'/X1)  +  (r-g  +  o-2/2)r2 

ajr2 

HS  +  2X  _ ^  jjjjr 


ln(,S7/)  +  (r-g  +  o-2/2)?1 


The  model  is  then  applied  to  a  sequential  problem  where  future  phase  options 
depend  on  previous  phase  options  (e.g.,  Phase  II  depends  on  Phase  I’s  successful 
implementation). 

The  variables  are  defined  as  follows: 

S  present  value  of  future  cash  flows  ($) 
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r  risk-free  rate  (%) 

<j  volatility  (%) 

0  cumulative  standard-normal 

q  continuous  dividend  payout  (%) 

/  critical  value  solved  recursively 

£2  cumulative  bivariate-normal 

X1  strike  for  the  underlying  ($) 

X2  strike  for  the  option  on  the  option  ($) 
t-i  expiration  date  for  the  option  on  the  option 
T2  expiration  for  the  underlying  option 

The  closed-form  differential  equation  models  above  are  then  verified  using  the  risk- 
neutral  market-replicating  portfolio  approach  assuming  a  sequential  compound  option.  In 
solving  the  market-replicating  approach,  we  use  the  following  functional  forms  (Mun,  2005): 
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Integrated  Risk  Management  Analysis:  Portfolio  Optimization 

Modern  Portfolio  Theory  (MPT)  was  introduced  by  Harry  Markowitz  with  his  paper 
“Portfolio  Selection,”  which  appeared  in  the  Journal  of  Finance  (1952).  He  demonstrated 
that  a  portfolio  of  individual  securities  composed  of  consistently  good  risk-reward 
characteristics  (e.g.,  stocks  of  all  rail  companies),  could  well  be  foolish.  He  detailed  the 
mathematics  of  diversification,  which  focused  on  selecting  portfolios  based  on  their  overall 
risk-reward  characteristics.  He  felt  that  investors  should  create  portfolios  of  dissimilar 
securities  rather  than  purchase  and  hold  only  individual  securities  (e.g.,  only  shares  of  IBM). 
Portfolio  theory  provides  a  broad  context  for  understanding  the  interactions  of  systematic 
and  non-systematic  risk  and  reward. 

Portfolio  optimization  is  the  analytical  technique  of  allocating  scarce  resources 
(limited  budget,  time,  cost,  human  resources,  and  program  requirements)  to  satisfy  and 
maximize  strategic  objectives,  or  determining  how  to  best  spend  limited  dollars  to  obtain  the 
best  or  optimal  outcome.  Portfolio  optimization  also  provides  tools  for  organizing  and 
managing  a  set  of  projects  in  a  portfolio  of  projects  to  meet  its  goal  (Mun,  2010).  Portfolio 
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management  begins  with  an  enterprise-level  identification  and  definition  of  market 
opportunities  and  then  prioritization  of  those  opportunities  within  resource  constraints  (GAO, 
2007,  p.  9).  A  set  of  projects  tracked  across  the  entire  portfolio  in  a  timely  and  effective 
manner  helps  senior  leadership  make  sound  decisions,  data-based  decisions  supported  by 
analysis  of  cost,  schedule,  and  performance  risks.  These  future  projects  will  have  a  national 
strategic  impact  as  situations  and  partners  change.  The  ability  of  senior  leadership  to  adjust 
portfolios  to  meet  defense  needs  now  and  in  the  future  is  critical. 

Portfolio  optimization  is  used  by  businesses  to  measure  everything  from  money  to 
performance.  In  the  finance  industry,  it  is  used  to  measure  the  strength  of  a  group  of 
investments  to  make  appropriate  tradeoffs  of  expected  return  on  investment  and  risk.  Using 
the  Markowitz  Efficient  Frontier  (MVO,  2009),  a  ratio  of  the  expected  return  for  each  asset, 
the  standard  deviation  of  each  asset’s  logarithmic  relative  returns  (measure  of  risk),  and  the 
correlation  matrix  between  these  assets,  sets  of  portfolios  with  expected  returns  greater 
than  any  other  with  the  same  or  lesser  risk,  and  lesser  risk  than  any  other  with  the  same  or 
greater  return  could  be  identified  (MVO,  2009).  In  the  Information  Technology  (IT)  sector, 
portfolio  optimization  is  used  as  follows: 

Portfolio  optimization  is  used  to  manage  priorities  for  resource  allocation.  Based 
on  limited  resources  (budget),  which  projects  should  we  keep  while  increasing 
profits  and  which  are  failing  to  perform  and  losing  money?  Whatever  is  being 
measured  during  the  analysis,  it  is  a  key  factor  in  the  success  or  failure  of  the 
business.  Companies  commonly  use  Net  Present  Value  (NPV)  analysis,  which 
can  show,  in  today’s  dollars,  the  relative  cash  flow  of  various  alternatives  over  a 
long  period  of  time.  (GAO,  2007,  p.  15) 

In  general,  successful  companies  take  a  disciplined  approach  to  prioritizing  needs 
and  initiating  a  balanced  mix  of  executable  development  programs  (GAO,  2007,  p.  7).  They 
begin  with  an  enterprise  level  approach  to  identifying  market  opportunities  and  then  prioritize 
them  based  on  strategic  goals,  resources  available,  and  risk.  The  market  opportunities  with 
the  greatest  potential  to  succeed  are  included  in  the  portfolio. 

So  why  is  portfolio  optimization  important  today?  The  Clinger-Cohen  Act  of  1996 
mandates  its  use  for  all  federal  agencies.  The  GAO’s  “Assessing  Risk  and  Returns:  A  Guide 
for  Evaluating  Federal  Agencies’  IT  Investment  Decision-Making,”  Version  1,  (GAO,  1997) 
requires  that  IT  investments  apply  ROI  measures.  DoD  Directive  8115.01  (DoD,  2005a), 
issued  October  2005,  mandates  the  use  of  performance  metrics  based  on  outputs,  with  ROI 
analysis  required  for  all  current  and  planned  IT  investments.  DoD  Directive  81 15.02  (DoD, 
2006)  implements  policy  and  assigns  responsibilities  for  the  management  of  DoD  IT 
investments  as  portfolios  within  the  DoD  Enterprise,  where  they  defined  a  portfolio  to  include 
outcome  performance  measures  and  an  expected  ROI.  The  DoD  Risk  Management 
Guidance  Acquisition  guide  book  requires  that  alternatives  to  the  traditional  cost  estimation 
be  considered,  because  legacy  cost  models  tend  not  to  adequately  address  costs 
associated  with  information  systems  or  the  risks  associated  with  them  (Mun  &  Flousel,  2006, 
p.  1).  The  CJCSI  8410.01  (CJSC,  2007)  establishes  policies  and  procedures  for  the 
Warfighting  Mission  Area  Information  Technology  Portfolio  Management  and  net-centric 
data  sharing  processes. 

Over  the  next  several  years,  the  DoD  plans  to  invest  $1 .4  trillion  in  major  weapons 
system  programs.  Continued  failure  to  deliver  weapons  systems  on  time  and  within  budget 
not  only  delays  providing  critical  capabilities  to  the  warfighter,  but  results  in  less  funding  for 
other  DoD  and  federal  needs  (GAO,  2007,  p.  1 ).  With  this  level  of  spending  and  an 
upcoming  reduction  in  DoD  obligation,  it  is  important  for  the  DoD  to  spend  its  money  as 
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efficiently  as  possible.  This  can  only  be  accomplished  by  better  evaluating  the 
programs/systems  for  risk  before  they  start  being  funded  to  truly  ascertain  their  overall  value 
toward  meeting  the  strategic  goals  of  the  U.S.  These  programs  contain  considerable  risks  in 
the  form  of  cost  overruns,  schedule  delays,  and  performance  failures. 

So,  what  is  the  DoD  currently  doing?  The  DoD  is  using  individual  program  managers 
to  manage  specific  programs/systems,  without  regard  to  the  overall  strategic  goal  of  the  U.S. 
Each  program  is  its  own  entity,  with  little  or  no  interaction  with  other  programs,  and  program 
managers  are  not  held  responsible  for  minimizing  the  risks  associated  with  their  particular 
programs.  The  DoD’s  service-centric  structure  and  fragmented  decision-making  processes 
are  at  odds  with  the  integrated,  portfolio  management  approach  used  by  successful 
commercial  companies  to  make  enterprise-level  investment  decisions  (GAO,  2007,  p.  18). 

In  2004,  the  Defense  Finance  and  Accounting  Service  (DFAS)  implemented  portfolio 
management  in  an  effort  to  help  prioritize  initiatives  and  more  closely  link  budget  to  agency 
strategy,  while  answering  a  presidential  call  for  improving  financial  management.  In  doing 
this,  they  developed  an  approach  which  not  only  governs  technology  investments  but 
includes  all  high-value  initiatives  ($250,000  or  more).  As  a  decision-making  tool,  Portfolio 
Management  requires  essential  data  about  all  initiatives  to  be  entered  into  a  central 
database  and  requires  those  initiatives  to  be  scored  against  basic  criteria  and  risk  (decision 
analysis).  Portfolio  Management  treats  existing  and  new  initiatives  as  assets  to  be  managed 
instead  of  costs.  The  process  is  dynamic  and  iterative  so  that  the  portfolio  reflects  changing 
agency  goals  and  priorities.  The  key  to  assessing  portfolio  effectiveness  is  measuring  the 
right  things.  Because  of  the  importance  of  performance  measures  in  completing  the  portfolio 
requirements,  it  is  crucial  for  DFAS  to  agree  on  the  appropriate  measures  early  in  the 
Portfolio  Management  process. 

Discussion  and  Conclusions 

The  KVA+SD+IRM  framework  for  modeling  and  evaluating  DoD  systems  was 
applied  to  the  adoption  of  collaborative  and  3D  TLS  in  SHIPMAIN  processes.  The  model 
extends  the  previous  KVA  modeling  by  including  important  implementation  costs  and 
improvements  in  performance  due  to  cycle  time  reduction  and  a  potential  increase  in  ship 
yard  maintenance  capacity.  Simulations  across  a  range  of  values  for  uncertain  conditions 
describe  a  defensible  range  of  potential  savings.  The  net  estimated  savings  are  substantial 
compared  with  the  current  approach  to  ship  maintenance,  from  $776  million,  if  four  yards 
adopt  the  improvements  for  five  years  and  reduce  average  cycle  time  by  20%,  to  well  over 
$8  billion,  if  all  seven  yards  adopt  the  improvements  over  15  years  and  reduce  cycle  time  by 
60%. 


Conclusions  From  the  Work 

The  approach  to  estimating  the  potential  impact  of  adopting  the  collab-PLM  +  3D 
TLS  technologies  on  ship  maintenance  costs  indicate  that  very  large  cost  savings  are 
possible.  And,  although  some  modeling  assumptions  may  not  become  realities  in  terms  of 
implementation  strategies  and  conditions,  the  results  of  the  current  work  provide  a  means  to 
analyze  the  potential  impacts  of  the  adoption  of  collab-PLM  +  3D  TLS  in  the  SHIPMAIN 
process  in  terms  of  cost  savings. 

Implications  for  Acquisition  Practice 

The  current  study  is  the  fourth  attempt  to  gauge  the  impact  of  these  technologies  and 
confirms  the  general  results  of  the  previous  three  studies:  adopting  these  technologies  will 
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result  in  substantial  cost  savings  and  productivity  increases.  Further,  the  current  study  also 
provides  a  practical  means  to  track  the  performance  of  these  technologies  over  time 
allowing  a  continuous  portfolio  optimization  based  on  learning  about  the  performance  of 
these  technologies  in  ship  maintenance  over  time. 

Limitations  of  the  Current  Study 

The  primary  limitation  of  the  current  study  is  the  absence  of  ship  maintenance 
performance  data  over  time.  Without  this  kind  of  performance  information,  it  becomes  very 
difficult  to  reassess  and  restructure  maintenance  resource  portfolio  allocations.  The  use  of 
systems  dynamics  provides  a  means  to  make  reasonable  estimates  based  on  a  model  that 
allows  variation  in  initial  conditions.  The  fact  that  the  current  study  model  mirrored  the  prior 
study’s  (Komoroski  et  al.,  2005)  empirically  derived  results  provides  some  compelling 
evidence  that  the  results  of  the  SD  modeling  provide  a  defensible  forecast  of  the  cost  saving 
impacts  of  these  technologies.  However,  real  historical  performance  data  would  provide  the 
best  means  for  forecasting  the  future  cost  savings  and  portfolio  optimization  impacts  of 
these  technologies  on  ship  maintenance. 

Next  Steps:  Portfolio  Optimization  and  Efficient  Frontier  Analysis 

The  follow  up  analysis  that  will  be  included  in  the  final  report  includes  applying 
portfolio  optimization  in  generating  efficient  portfolios  and  an  investment  efficient  frontier.  As 
discussed  earlier,  optimization  is  the  process  of  iteratively  finding  the  best  combination  of 
projects,  processes,  and  decisions  that  will  maximize  a  portfolio’s  total  outcome  or  objective. 
Running  the  optimization  procedure  will  yield  an  optimal  portfolio  of  projects  where  the 
constraints  are  satisfied.  This  represents  a  single  optimal  portfolio  point  on  the  efficient 
frontier,  for  example,  Portfolio  B  on  the  chart  in  Figure  5.  Then,  by  subsequently  changing 
some  of  the  constraints,  for  instance,  by  increasing  the  budget  and  allowed  projects,  we  can 
rerun  the  optimization  to  produce  another  optimal  portfolio,  given  these  new  constraints. 
Therefore,  a  series  of  optimal  portfolio  allocations  can  be  determined  and  graphed.  This 
graphical  representation  of  all  optimal  portfolios  is  called  the  Portfolio  Efficient  Frontier.  At 
this  juncture,  each  point  represents  a  portfolio  allocation;  for  instance,  Portfolio  B  might 
represent  projects  1, 2,  5,  6,  7,  8,  10,  15,  and  so  forth,  while  Portfolio  C  might  represent 
projects  2,  6,  7,  9,  12,  15,  and  so  forth,  each  resulting  in  different  tactical,  military,  or 
comprehensive  scores,  and  portfolio  returns. 

It  is  up  to  the  decision-maker  to  decide  which  portfolio  represents  the  best  decision, 
and  if  sufficient  resources  exist  to  execute  these  projects.  Typically,  in  an  Efficient  Frontier 
analysis,  you  would  select  projects  where  the  marginal  increase  in  benefits  is  positive,  and 
the  slope  is  steep.  In  the  next  example,  you  would  select  Portfolio  D  rather  than  Portfolio  E, 
as  the  marginal  increase  is  negative  on  the  y-axis  (e.g.,  Tactical  Score).  That  is,  spending 
too  much  money  may  actually  reduce  the  overall  tactical  score,  and  hence  this  portfolio 
should  not  be  selected.  Also,  in  comparing  Portfolios  A  and  B,  you  would  be  more  inclined  to 
choose  B,  as  the  slope  is  steep,  and  the  same  increase  in  budget  requirements  (x-axis) 
would  return  a  much  higher  percentage  Tactical  Score  (y-axis).  The  decision  to  choose 
between  Portfolios  C  and  D  would  depend  on  available  resources  and  the  decision-maker 
deciding  if  the  added  benefits  warrant  and  justify  the  added  budget  and  costs. 
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Figure  5.  Efficient  Frontier  Example 

To  further  enhance  the  analysis,  you  can  obtain  the  optimal  portfolio  allocations  for  C 
and  D,  and  then  run  a  simulation  on  each  optimal  portfolio  to  decide  what  the  probability  that 
D  will  exceed  C  in  value  is,  and  whether  this  probability  of  occurrence  justifies  the  added 
costs. 


For  the  next  steps  in  this  study,  the  current  research  portfolio  optimization  and  MPT 
will  be  applied  at  several  levels,  from  the  macro  level  to  the  micro  level.  The  final  results  of 
the  MPT  optimization  will  be  included  in  the  final  report  to  the  Acquisition  Program  and  will 
be  available  through  the  NPS  Acquisition  Program. 
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Research  Context 


•  Part  of  a  project  to  test  the  application  of 
Modern  Portfolio  Theory  to  naval  acquisition 

•  This  is  a  progress  report,  not  final  results 

•  Application  of  integrated  Knowledge _ e 

Added  (KVA),  System  Dynamics  (SD),  and 
Integrated  Risk  Management  (IRM) 

•  Based  on  previous  demonstration  of 
integrated  use  of  KVA  and  SD  (NPS-GSBPP- 
10-015) 
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The  Fleet  Maintenance  and 
Improvement  Analysis  Challenge 


•  Getting  the  “Biggest  Bang  for  the  Buck” 
(Benefit/Cost  Analysis)  requires  including 
chan  es  in  benefits  as  well  as  changes  in  costs 
•A  purely-cost  focus  can  cut  more  efficient 
ro  rams  and  efforts  that  cost  more 

■  w 

•Analysis  of  cost-saving  programs  must  include 

program  benefits  in  program  a.._.., _ o  .... . , 

the  best  programs  to  invest  in. 
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Example:  The  Shipmain  Process  of  Ship 
Improvement 

•  Industry  reduces  costs  through  repeating  non- 
redundant  processes  to  capture  learning  curve 
effects. 

•  Navy  has  been  unable  to  capture  similar 
learning  curve  based  cost  savings  in  shipyards 

•  Shipmain  revised  (2006)  ship  improvement 
process  to  generate  timely,  effective,  and 
affordable  planning,  budgeting,  engineering, 
and  installation  of  shipboard  improvements 


The  Shipmain  Process 

•  Develop  and  adopt  a  common  planning  process 
for  maintenance  and  alterations  -  eliminate 
process  redundancies 

•  Apply  best  business  practices  to  reduce  costs 
based  on  learning  curve.  I  ne  original  smpmain 
plan  included: 

-  3D  Terrestr.  u ■  tuSvi  Svui  ■  ni..g  . echnology 

(3D  TLS) 

-  Collaborative  Product  Lifecycle 
Management  (collab-PLM)  process  and  tools 


3D  Terrestrial  Laser  Scanning 

•  Laser  scans  space  from  highly 
articulated  mount 

•  Software  processes  points  into 
3D  image  of  the  space  (within  3/16”; 
ready  for  CADD,  etc. 

•  Can  be  combined  with  360°  camera 

•  Currently  used  in  automotive,  offshore 
construction  and  repair,  civil  and 
transportation,  building  construction,  fossil 
fuel  and  nuclear  power  plants 
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Collaborative  Product  Lifecycle 
Management 

•  To  “integrate  people,  processes,  and 
information” 

•  Electronically  integrates  3D  TLS  for 
participant  collaboration  across  physical 
distances 

•  common  aataoase  ot  images  ana  reiatea 
data  for  improved  access 

•  Common  platform  for  program  change 
management 
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Impacts  of  3D  TLS  and  Collaborative 
PLM  on  Shipmain 
•  Operations 

-  Faster  ship  condition  data  collection 

-  Shorter  ship  visits 

-  Faster  translation  of  ship  conditions  to  information  for  design 

-  Faster  conflict  identification 


-  Automate  drawing  development 


•  Result:  Cycle  time  reduction  (40-60%  in  other 
industries) 

•  Initial  purchase  and  installation  cost  ($1 .6m) 
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Modelin  Shipmain  Plannin  Processes 


•  Focus  on  ship  improvement  planning 
processes 

•  SD  expansion  of  existing  steady  state 
model  (NPS-AM-06-003)  to  better  reflect 
actual  conditions... 

•  Seven  mostly  sequential  core  processes  -> 

•  28  unique  subprocesses 

-  Simulate  operational  benefits  of  operations 
(common  units  of  outputs) 

-  Simulate  operating  costs 

-  Calculate  unit  cost  ($/common  unit) 


Issue  Tasking 


Interpret  Orders  ) 

i 

;  Plan  for  Shipcheck  . 


Conduct  Shipcheck 


Report  Assembly 


Revise  Schedule 


t: 

Generate  Drawings  ’ 
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Improved  Modeling  of  Benefits  and  Costs 

Benefits 

•  More  realistic  description  of  possible  benefits  with  different  number 
of  yards  using  3D-TLS  +  collabPLM 

•  Faster  processes  create  increased  ships  processed  if  3D-TLS  + 
collabPLM  are  adopted  due  to  the  reduced  cycle  time 

•  Lifespan  or  use  ot  3U-TLS  +  collabPLM  before  adoption  of  a  new 
technology  -  longer  lifespan  increases  benefits 

Costs 

•  Initial  costs  to  purchase  and  install  collab.  PLM  software  and  license 
users 

•  Costs  to  install  3D-TLS  at  the  shipyards 

•  Reduced  operations  cost/ship  due  to  faster  processes 


Simulation  Cases  and  Results 

Savings  =  (UnitCostas_is  -  UnitCostto_be)  *  Ships  Improvedto.be 


Simulated  SHIPMAIN  Cost  Savings  due  to 
Adoption  of  3D  TLS  and  Collaborative  PLM 


Shipmain 
Cost  Savings 
(*  $1,000,000)| 

Scale  of  Adoption  and  Cycle  Time  Reduction 

1  4  vards. 

4  vards. 

4  vards. 

7  vards. 

7  vards. 

7  vards.  II 

f  20%  CT 

Ireduction 

40%  CT 

reduction 

60%  CT 

reduction 

20%  CT 

reduction 

40%  CT 

reduction 

60%  CT  | 

reductionj 

rz - 1 

o  5  years  | 

|C  $776 

^  $1,038 

$1,559 

$1,362 

$1,819 

$2,731 

3  0) 

O  _i  10  years 

$1,555 

$2,076 

$3,121 

$2,726 

$3,639 

$5,465 

(L 

L  15  years 

!  $2,333 

$3,116 

$4,680 

$4,091 

$5,461 

($8,199 

Forecasted  savings  =  $776m  -  $8, 199m 


Simulation  Results 


Simulated  SHIPMAIN  Cost  Savings  ($million)  due  to 
Adoption  of  3D  TLS  and  Collaborative  PLM 


$9,000 


4  yards,  20%  CT  4  yards, 40%  CT  4  yards,  60%  CT  7  yards,  20%  CT  7  yards,  40%  CT  7  yards,  60%  CT 

reduction  reduction  reduction  reduction  reduction  reduction 


Cost  savings  increase  with  the  number  of  yards  adopting 
collaborative  PLM  and  3D  TLS,  product  life  span,  and  the  size  of  the 

reduction  in  cycle  time. 
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Potential  Model  Improvements  for  Planning 
Adoption  of  3D-TLS  +  collabPLM 

•  Ramp-u  of  ado  tion  ex  ect  lower  earl 
savings  and  more  with  longer  usage) 

•  Variance  in  process  rates  over  time 
(unclear  impact) 

•  Share  costs  with  ship  design  and 
construction  processes  (expect  large 
savings  increase) 


Integrated  Risk  Management 
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List  of  projects 
and  strategies 


Z 

O 

HH 

5 

U 


H 

Z 

W 

Q 

HH 

if) 

HH 


Start  with  a  list  of  projects  or 
strategies  to  be  evaluated. . .  these 
projects  have  already  been 
through  qualitative  screening 
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Base  case  projections 
for  each  project 
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Time  Series  Forecasting 


. .  .with  the  assistance  of  time- 
series  forecasting,  future 
outcomes  can  be  predicted... 
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Develop  static 
financial  models 
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. .  .the  user  generates  a  traditional 
series  of  static  base  case  financial 
(discounted  cash  flow)  models  for 
each  project... 


O 


Dynamic  Monte 
Carlo  simulation 


Lognormal 
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. .  .Monte  Carlo  simulation  is  added  to  the 
analysis  and  the  financial  model  outputs 
become  inputs  into  the  real  options 
analysis... 


Framing 
Real  Options 


o 


Options  analytics, 
optimization 


simulate 


Simulation 


Lattice 


04 .  .the  relevant  projects  are  chosen 
for  real  options  analysis  and  the 
project  or  portfolio  real  options  are 
framed. . . 
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...real  options  analytics  are  calculated 
through  binomial  lattices  and  closed-form 
partial-differential  models  with  simulation. . 


O 


Portfolio  optimization 
and  asset  allocation 


o 


Reports  presentation 
and  update  analysis 


OPTIMIZATIO 

IV 

IN 

. .  .stochastic  optimization  is  the  next 
optional  step  if  multiple  projects  exist  that 
require  efficient  asset  allocation  given 
some  Duagetary  constraints...  usetui  ior 
strategic  portfolio  management. . . 
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'...create  reports,  make  decisions,  and 
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Next  Steps: 

Monte  Carlo  Risk  Simulation  is  run  (10,000-1,000,000  trials) 


o 

■ 

X! 

Normal 
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Uniform 

i  1 

T  riangular 

K £ 

Custom 

111 
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Normal  Distribution 

The  normal  distribution  is  the  most 
important  distribution  in  probability  theory 
because  it  describes  many  natural 
phenomena,  such  as  people's  IQs  or 
heights.  Decision  makers  can  use  the 
normal  distribution  to  describe  uncertain  v 


Acquisition  Eest-arch  Program:  Creating  Synergy  for  Informed  Change 


Naval  rK^iRrJilLLaic  Hcliool 
Mcinlcrcj-%  CA 


11/5/2009 


Next  Steps: 

Framing  the  Strategic  Options  (COA/AOA) 


AS-IS  situation.  Proceed  with  Maintain  baseline 

the  process  without  any  attempt  condition 

to  introduce  new  technologies. 

Baseline  situation  option  of 
leaving  things  the  way  they  are. 
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Modern  Portfolio  Theory  Applications 


Theory  evolved  from  Markowitz  to  Sharpe 

OPTIMAL  portfolio  diversification,  portfolio  allocation,  project 
selection 

Objective  is  to  maximize  returns  or  benefits  with  the  least 
amount  of  cost  and  schedule  risk,  subject  to  some  budget,  time, 
or  cost  constraints 

SHIPMAIN:  upstream  and  downstream  applications... 
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Next  Steps: 

Investment  Efficient  Frontiers  analysis  provides  for  a  variety 
of  budget  scenarios  when  considering  portfolios  of  options 


Budget 

Comprehensive 

Score 

Tactical 

Score 

$3,800.00 

33.15 

62.64 

$4,800.00 

36.33 

68.85 

$5,800.00 

38.40 

70.46 

$8,800.00 

39.94 

72.14 

$ 7,800.00 

39.76 

70.05 

Military  Score 

Allowed 

Projects 

ROI-RANK 

Objective 

58.58 

10 

$470,235.60 

66.86 

11 

$521,645.92 

75.69 

12 

$623,557.79 

82.31 

13 

$659,947.99 

86.54 

14 

$676,279.81 
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Conclusions 


Adopting  3D-Terrestial  Laser  Scanning  and  Collaborative 
Product  Lifecycle  Management  can  greatly  reduce 
Shipmain  costs 

Additional  modeling  can  facilitate  the  planning  of 
adoption  implementation 

Modem  Portfolio  Theory  may  be  capable  of  describing 

and  facilitating  tuv  uvkjigii  vx  wiivvtiviiu  vx  nu,  y  j  tiuuvi/U 

that  better  balance  risk  and  reward  subject  to  cost  and 
schedule  risk  minimization 
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Questions? 

comments? 

Discussion? 
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